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A computer control system that allows a user of a remotely 
located workstation to control a target computer. A host computer 
runs a remote control program that tnmsraits data in its video memory, 
and teyboard and mouse buffers to the remote workstation. The video 
signals of the target computer are digitized and stored in the host 
computer's video memory. In addition, keyboard and mouse signals to 
and from the target computer are stored in the host computer's keyboard 
and mouse buffers. Ihe host computer then transmits these sisals using 
the remote control program to the remotely located workstation. 
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REMOTE COMPUTER CONTROL SYSTEM 

Field of the Invention 
The present invention relates to computer systems in general, and in particular 
to systems for accessmg and controlling remotely located computers. 
5 Background of the Invention 

In most ofiBce or manufacturing environments, it is common to find a number 
, of computer systems connected together by a local area or wide area network. In 
general, these networks include one or more swver computers that control the 
network and provide additional services, such as storing commonly used programs, 
10 controlling network resources, and connectmg the network to other wide area 
networks such as the Internet etc. 

In the event that a problem occurs with a computer network, a system 
administrator may need to reboot or otherwise adjust the operation of one or more of 
the controlling server computers. Because the network is malfimctioning, it is 
IS generally not possible to access the server computers over the network and therefore 
the administrator must be physically present at the console of the server computer. 

Most server computers are located in spedally equipped rooms that are often 
heaxoly air conditioned and otherwise not particularly smted for a human operator. As 
a result, systems have been developed that can allow an operator to control a 
20 computer from a remote location. 

One example of such a system is the Switchback® product manufactured by 
Apex PC Solutions, Inc. of Woodinville, WA, the assignee of the present invention. 
With the Switchback product, a user can control the operation of the computer from 
a remote workstation of the type that includes a monitor, a keyboard, and a mouse. 
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Commands entered with the keyboard and mouse are transiniitted over a dedicated 
communication link such as a twisted wire cable» that is connected to the computer 
system to be controlled. The computer system then acts as if the commands were 
entered using its own keyboard or mouse. In addition, analog video signals produced 
5 by the controlled computer are transmitted to the video monitor of the workstation so 
that the operator can view the same display that is produced at the remotely 
controlled computer. While the Switchback product works well for many 
applications, there is a limit to how far the video, keyboard, and mouse signals can be 
transmitted on the dedicated communication link without a loss of resolution. 

10 An ahemative approach to systems like the Switchback product is to use a 

computer program that allows a computer to be controlled from a remote location. 
For example, PCAnywhere™ produced by Symantec of Cuptertino, California allows 
a computer to be accessed and controlled &om a remote location. However, to 
control a computer using a program such as PCAnywhere™, requires that the 

15 program be running on the controlled computer. Tlus both slows the operation of the 
controlled computer as well as provides a potential source of malfiinction. 

Therefore, there is a need for an out-of-band system that can be used to access 
and control a remotely located computer that operates over long distances and does 
not slow or degrade the operation of the controlled computer. 

20 Summary of the Invention 

To solve the problems associated with prior art remote computer access and 
control systems, the present invention is a system for operating a target computer 
from a remotely located personal computer workstation. The workstation includes a 
keyboard and mouse with which commands can be entered for the target computer. 

25 In addition, the workstation includes a video monitor that displays video signals 
generated by the target computer. 

To connect the remote workstation with the target computer, the invention 
includes a host computer disposed between the target computer and the woricstation. 
The host computer receives the analog video signals produced by the target computer 

30 and digitizes them for storage in its video memory. In addition, keyboard or mouse 
signals generated by the target computer are stored in keyboard and mouse buffers 
within the host computer. The host computer operates a remote access and control 
computer program that transmits the contents of the video memory, and the keyboard 
and mouse buflFers to the remotely located workstation via a communication link. The 

35 remote workstation runs a complementary remote access and control computer 
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program that enables it to transmit keyboard and mouse signals to the target computer 
via the host computer. The present invention, therefore, does not require that the 
target computer operate special software and can transmit the video, keyboard, and 
mouse signals over greater distances than were previously possible. 
5 Brief Description of the Drawings 

The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same becomes better understood by 
reference to the following detailed description, when taken in conjunction with the 
accompanying drawmgs, wherein: 
10 FIGURE 1 is a block diagram of a system for accessing and controlling a 

remotely located computer system according to the present invention; 

FIGURE 2 is a block diagram of a video digitizer according to another aspect 
of the pre sent invention; 

FIGURE 3 illustrates a video memoiy of a host computer that stores digitized 
15 video signals prior to transmission to a remotely located workstation; and 

FIGURE 4 illustrates a typical analog video signal received from a target 
computer. 

Detailed Description of the Preferred Embodiment 
As indicated above, the present invention is a system for accessmg and 
20 controlling a computer from a remote workstation without requiring that the accessed 
computer run a special computer program. The system transmits digitized video, 
keyboard, and mouse signals over a serial commumcation link to the remote 
workstation. 

FIGURE 1 is a block diagram of the remote computer access and control 
25 system according to the present invention. Using the system, a user of a remote 
workstation 10 can access and control any of a number of target con^)Uters 20a, 20b, 
20c, or 20d. Typically, the target computers are server computers that are connected 
to a computer network and operate to perform such tasks as controlling the operation 
of the network, storing commonly used programs or data, or connecting the network 
30 to the Internet, etc. 

The remote personal computer type workstation generally comprises a central 
processing unit 12, including a communication device such as a modem (not shown), 
a monitor 14, a keyboard 16, and a pointing device such as a trackball, touch pad, or 
mouse 18. Commands or keystrokes entered using the keyboard 16 or mouse 18 
35 operate to control the target computer as if the commands had been entered using a 
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keyboard and mouse that are connected directly to the target computer. In addition, 
the monitor 14 of the remote workstation displays the same video signals that are 
produced by the target computer 20. 

To access and control the target computers 20, the present invention utilizes a 
S host computer SO that acts as an interface between a target computer and the remote 
workstation. The host computer 50 includes a central processing unit 52, a 
modem 53, a video monitor 54, a keyboard 56, and a pomting device such as a 
mouse 58. 

The host computer 50 operates to fill a portion of a video memory 60 with the 

10 video signals produced by one of the target computers 20. In addition, the host 
computer fills a set of keyboard/mouse bufifers62 with keyboard and mouse 
commands to be sent to, or received from one of the target computes 20. 

The host computer 50 includes a video digitizer 70 that receives the analog 
video signals produced by one of the target computers 20 and digitizes the agnals for 

15 storage in a portion of the host computer's video memory 60. The host computer 
runs a remote access and control computer program that transmits the contents of the 
video memory over a communication link 66 to the remote workstation 10 so that the 
monitor 14 of the workstation will display the same video signals displayed by the 
target computer 20. In addition, the same video signals produced by the target 

20 computer 20 are also displayed on the monitor 54 of the host computer 50. 

Keyboard and mouse control signals produced by the target computer 20 are 
transferred through a keyboard/mouse interface 72 within the host computer SO for 
storage in the keyboard/mouse buffers 62, The buffers 62 include separate keyboard 
data and control buffers, as well as separate mouse data and control buffers. 

25 Keystrokes entered on the keyboard 16 of the remote workstation or on the 
keyboard 56 of the host computer 50 are stored in the keyboard data buffer. These 
keystrokes are then forwarded through the keyboard/mouse interface 72 to a 
keyboard connector on the target computer 20 in order to control the operation of 
the target computer. Signals from the mouse 18 or 58 are similarly stored in the 

30 mouse data buffers before being applied to a mouse connector on tiie target 
computer 20. In the other direction, keyboard control signals such as signals to light 
indicators on the keyboard are stored in the keyboard control buffer before being 
transmitted to the remote workstation, as well as the keyboard and mouse of the host 
computer. 
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To provide the ability of the remote workstation 10 to control multiple target 
computers, the present invention preferably includes a bi-directional switch 74 that is 
disposed between the host computer 50 and the target computers 20. Each of the 
target computers 20a, 20b, 20c, and 20d is connected to the switch 74 by three 
5 cables. A cable 76 is connected to the target computer's video out connector. A 
cable 78 connects to the target computer's keyboard connector and a cable 80 is 
connected to the target computer's PS/2 mouse connector. Connecting the switch 74 
to the host computer 50 are an additional three cables. A cable 82 carries video 
signals from one of the target computers to a video digjtizer 70 described in detail 

1 0 below. A cable 84 carries keyboard signals from the switch 74 to the keyboard/mouse 
interface 72 and a cable 86 carries the mouse signals between the switch 74 and the 
keyboard/mouse interface 72. With the switch 74, video signals produced by any of 
the target computers 20a, 20b, 20c, or 20d can be selected and the keyboard and 
mouse signals can be directed to any of the target computers. The switch 74 may 

15 comprise an Outiook™ switch produced by Apex PC Solutions, Inc. of Woodinville, 
Washington, the assignee of the present invention or other suitable computer 
switches. 

To transmit the video, keyboard, and mouse signals to the remote 
workstation, the host computer 50 also runs a remote access and control computer 

20 program such as PCAnywhere™ to control the modem 53 that transmits the contents 
of a portion of a video memory 60 and the keyboard/mouse buffers 62 over the 
communication link 66 that connects the host computer 50 with the remote 
workstation 10. The communication link 66 may comprise a telephone line, a wireless 
communication link, or a global, wide area network such as the Internet. The remote 

25 workstation 10 also runs a remote access and control program in order to display the 
video signals on the monitor 14 and to transmit keystrokes and mouse signals back to 
the host computer 50 for forwarding to tiie target computer. 

As indicated above, the switch 74 routes the analog video signals received 
from one of the target computers into the video di^tizer 70. A block diagram of the 

30 video digitizer 100 is shown in FIGURE 2. To digitize the analog video signals, the 
vertical and horizontal synchronize signals must be detected. These signals may be 
supplied on separate leads, combined on a single lead, or may be encoded onto one of 
the red, green, or blue video signals depending upon the type of computer that is 
providing the analog video signals. The leads containing the horizontal and vertical 

35 synchronize signals are applied to a synchronize detect and separation circuit 102 that 
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detects these signals and converts them to the proper polarity. For example, some 
horizontal and vertical synchronize signals may be active low while others are active 
high. The synchronize detect and separation circuit 102 preferably converts the 
signals so that they are active high logic levels. A suitable synchromze detect and 
5 separation circuit 102 is part No. IN2100, produced by Mine, Inc., of LaHabra, 
Califonua* 

The vertical synchronize signal is sent from the synchronize detect and 
separation circuit 102 to a microprocessor 104 that controls the operation of the 
digitizer The horizontal synchronize signal is fed to an input of a counter 107 that 

10 counts the number of horizontal synchronize signals received. The 
microprocessor 104 signals the counter 107 each time a v^ical synchronize signal is 
received so that the counter can begin counting. Upon the receipt of the next vertical 
synchromze signal, the counter informs the microprocessor how many lines are 
contamed per frame of video data and restarts the count. The microprocessor uses 

15 this information to index a look up table to determine a range of "dot clock" values 
that define the rate at which the colors for each pixel in a row of video data are 
transmitted m the analog video signal. In addition, the microprocessor 104 
determines the time between the falling edge of a vertical synchromze signal and the 
beginning or rising edge of a subsequent vertical synchronize signal. This time 

20 determines the vertical size of a frame of ^deo data and is used to refine the dot clock 
estunation. 

The horizontal synchronize signal detected by the synchronize detect and 
separation circuit 102 is also applied to an input of a phase lock loop circuit 106, The 
phase lock loop circuit compares the phase of the horizontal synchromze signal to the 

25 phase of a clock signal produced by a programmable divider 108. The output of the 
phase lock loop ckcuit 106 drives an input of a voltage controlled oscillator 110 to 
produce a clock signal having a frequency that is proportional to the output of the 
phase lock loop circuit 106. The dock signal produced by the voltage controlled 
osdllator 1 10 is supplied to an input of a programmable divider 112 that may reduce 

30 thefrequency ofthelnconMng clock signal by a prognumnable amount. Because the 
voltage controlled oscillator 110 has a limited frequency range, the prognunmable 
divider 112 increases the useful operating range of the clock signal produced to 
accommodate lower resolution video signals. When operating properly, the output of 
the programmable divider 1 12 has the same frequency or a multiple of the dot clock. 
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The initial settings for the programmable dividers 108 and 112 are set by the 
microprocessor based on the initial values of the dot clock frequency read from the 
look up tables. The output of the programmable (^vider 112 is fed to an input of the 
prbgranmiable ^der 108 that feeds the input of the phase lock loop circuit 106 
5 described above. 

The output of the programmable divider 1 12 is also fed to an input of a gating 
counter 1 14 that is activated to pass the output signal produced by the programmable 
divider 1 12 during the active portion of the video signal. As vM be appreciated by 
those skilled in the art, a video signal for a horizontal row of a video display 

10 comprises an active video portion and a blanking portion that occurs when the video 
signal retraces. In order to avoid sampling the video signal during the retrace period, 
the gating counter is programmed to pass the clock signal produced by the 
programmable divider 1 12 only during the active video portion of the video signal. 

During the active video portion of the video signal, the clock signal produced 

15 by the programmable divider 1 12 is passed by the gating counter 1 14 to an input of a 
phase adjust circuit 116. The phase adjust circuit is set so that the active video 
portion of the video signal is sampled at the center of each pixel value. If the pixel is 
not sampled at the center, the resulting video image can appear blurry or shadowed. 
Therefore, the phase adjust circuit changes slightly the phase of the incoming clodc 

20 signal based on signals received by a user of the remote workstation who may press 
one key to advance the sampling time and another key to retard the samplmg time 
until the display looks the best. Alternatively, the phase adjust drcuit may be 
controlled by the microprocessor 104. 

The output of the phase adjust circuit 116 clocks an analog to digital 

.25 converter 1 18 to sample a video signal. The red, green, and blue analog \adeo signals 
received from a target computer are supplied to a sequencer 120 that operates as a 
three-way switch. The sequencer selects one of the video signals to be sampled by the 
analog to digital converter 118. Each time the di^tizer is clocked^ a sample of the 
video signal is recorded for storage m the host computer's video memoiy. After an 

30 entire frame of video signals has been sampled, the sequencer 120 selects another of 
the red, green, or blue video signals in a rotating fashion. It is also possible to sample 
all three video signals simultaneously with the addition of two further analog to digital 
converters. 

The output of the analog to digital converter 118 feeds a digital signal 
35 processor 122 that determines whether the analog to digital converter 1 18 is sampling 
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the active portion of video signals at the coirect time. If not, the DSP can instruct the 
phase adjust circuit 1 16 to adjust the phase of the sampling clock. The digital signal 
processor analyzes the received samples and instructs the microprocessor to adjust the 
timing or phase of the clocking signal until the mmimum and maximum amplitudes of 
5 the incoming video dgnal are located. 

The sample of the video signal produced by the analog to digital converter 118 
is fed to a peripheral component interface (PCI) bus master chip 124. The bus master 
chip 124 writes the data on a PCI bus 126 that connects the video digitizer with the 
host computer's video memory 60. After storage in the video memory, the video data 

1 0 is transmitted to the remote workstation by the host computer. 

FIGURES illustrates a typical video signal to be sampled with the 
superimposed horizontal qmchronize signal. Marking the beginning of a row of 
active ^deo data is a horizontal synchronize signal 150. The time between successive 
horizontal synchronize signals defines the horizontal clock rate of the video display. 

15 The time between the beginning of a horizontal synchronize signal and the active 
portion of the video signal, shown as t^, is defined by the resolution of the particular 
video display. Upon the detection of a horizontal synchronize signal, the gating 
counter 114 described above, times an interval equal to t^ before passing the clock 
signal produced by the programmable divider 112 to the phase adjust circuit 1 16. 

20 The active portion of the video signal is sampled once for every pbcel that 

comprises a row of the video display. The clocking signals produced by the 
programmable divider 112 have a period equal to the dot clock of the video display 
t^^j. The gating counter 1 14 counts the number of clocking signals received and 
prevents the clocking signals from reaching the phase adjuster 116 after the video 

25 signal has been sampled one tune for each pixel in the display. The gating counter is 
programmed with the correct number of pixels in a display either by the 
microprocessor given the number of rows in a video fi^e as determined by the 
counter 107 described above or by allowing a user to select from a mimber of typical 
resolutions. Typical resolutions include 1024 X 768, 640 X 480, 800 X 600, etc. 

30 At the end of the active portion of the video signal, the signal is blanked out 

during the video retrace. The length of the blanking period, shown as t^, is also 
defined by the resolution of the video signal and the particular type of computer that 
generates the display. Once the next horizontal synchronize signal is obtained, the 
gating counter again allows the clocking signals to reach the phase adjuster 1 16, after 

3 5 timing an mterval t^. 
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FIGURE 4 illustrates how the digitized video signals are stored in the video 
memory of the host computer. The video memory 200 can be overwritten and read 
asynchronously. Therefor^ the video digitizer can be writing values to the memory as 
the host computer is reading the memory and transmittmg the digitized video ^gnals 
5 to a remote workstation. 

As indicated above, the present invention preferably fills the video memory by 
overwriting one color at a time. For example, the memory comprises a series of 
memory bytes 202 each containing values for the red, green, and blue pixel intensities. 
The red values of each pixel in a video frame are digitized and written into the 
10 memory followed by green pixel values for the next frame and blue pbcel values for 
the subsequent frame. Because a video image does not change significantly from 
frame to fi^e, the efifect of updating only one color at a time is not noticeable to the 
user. 

As can be seen from the above, the present invention allows a remote 
15 computer to access a target computer without requiring that the target computer run 
its own remote control program. Using a single host computer and two copies of a 
remote access and control computer program, a remote workstation is able to control 
multiple target computers. The present invention therefore allows network 
administrators or other support personnel to access server computers from a remote 
20 location over a variety of serial data conmiunication links. 

While the preferred embodiment of the invention has been illustrated and 
described, it will be appreciated that various changes can be made therein without 
departing from the spirit and scope of the invention. It is therefore intended that the 
scope of the invention be determined from the following clmms and their equivalents. 
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The embodiments of the invention in wMch an exclusive property or privilege 
is claimed are defined as follows: 

1. A system for controlling a target computer from a remote workstation 
of the type that inchides a keyboard, a mouse, and a momtor, comprising: 

a host computer including a video memory and keyboard/mouse bufifers that 
store dgnals from a keyboard and a mouse; 

a video digitizer coupled to the host computer that receives analog video 
signals from the taiget computer, samples the video signals, and stores the video 
signals in the video memory; 

a keyboard/mouse interface that receives keyboard and mouse signals from the 
target computer and stores them in the keyboard/mouse buffers; and 

the host computer operating a remote access and control program that 
transmits the contents of the video memofy and the keyboard/mouse buffers to the 
remote workstation over a communication link. 

2. The system of Claim 1, wherein the host computer receives keyboard 
and mouse signals from the remote workstation, stores the received keyboard and 
mouse signals in the buffers and forwards the contents of the k^oard/mouse buffers 
to a keyboard and mouse input on the target compute. 

3. The system of Cl^m 1, further comprising a switch disposed between 
the host computer and one or more target computers. 

4. The system of Claim 1, wherein the communication link is a telephone 

line. 

5. The system of Claim 1, wherein the communication link is a wireless 

link. 

6. The system of Claim 1, wherein the communication link is a computer 
network. 



7. The system of Clahn 1, wherein the video digitizer mcludes a phase 
lock loop that produces a clocking signal having a frequency substantially equal to the 
time at which pixel values are transmitted in the video signal and a gating counter that 
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passes the clocking signal to an analog to digital converter that samples the video 
signal during an active video portion of the video signal. 

8. The system of Claim 1, wherein the video digitizer alternately samples 
a single color video signal in a frame of video data and stores the samples in the video 
memory. 

9. A video digitizer for recerwng analog video ^gnals at a plurality of 
resolutions and for storing the video signals in a video memory of a host computer 
comprising: 

a synchronize detect circuit that detects vertical and horizontal ^chronize 
signals from an analog video signal; 

a microprocessor that determines a clocking rate at which the analog video 
signal should be sampled from the timing of the vertical and horizontal synchronize 
signals; 

a clock signal generator that produces a clock signal at the clocldng rate; 

an analog to distal converter that is controlled by the clock signal to sample 
the analog video signal; and 

a bus interface circuit that writes the samples of the analog video signal into 
the video memory of the host computer, 

10. The video digitizer of Claim 9, wherein the clock signal generator 
comprises: 

a phase lock loop circuit that compares the phase of the horizontal 
synchromze signal with the phase of a divided clocking signal; 

a variable oscillator that produces the clocking signal that controls the analog 
to distal converter, wherein the clocking signal has a frequency that is dependent on 
the difference in phase between the horizontal synchronize signal and the divided 
clockbg signal; and 

a programmable didder that recdves the clocking signal produced by the 
variable oscillator and produces the divided clocking ^gnal that is fed to the phase 
lock loop circuit. 

1 1 . The video digitizer of Cldm 1 0, further comprising a gating circuit that 
receives the clocking signal and passes the clocking signal to the analog to digital 
converter during an active video portion of the analog video signal. 
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12. The video digitizer of Claim 10, further comprising a phase adjust 
circuit that adjusts the phase of the clocking signal. 

13. The video digitizer of Claim 9, further comprising a selection circuit 
that alternately selects a red, green, and blue component on the analog video signal to 
be sampled by the analog to digital converter. 

14. The video digitizer of Clahn 9, wherein the analog to digital converter 
includes separate analog to digital converters to sample the red» green, and blue 
components of the analog video signal. 

15. The video digitizer of Claim 9, wherein the host computer operates a 
remote access and control program that transmits the contents of the video memory 
to a remote computer system. 

16. A system for controlling a target computer from a host computer 
comprising: 

a video digitizer that receives analog video ^gnals from the target computer 
and stores the video signals in a video.memoiy within the host computer for display 
on a monitor coupled to the host computer, 

a set of keyboard and mouse buffers that store keyboard and mouse control 
fdgnals from the target computer as well as keyboard and mouse data signals that are 
received from a keyboard and mouse coupled to the host computer, and 

wherem the host computer transmits the contents of the set of keyboard and 
mouse bufifers to the target computer in order to control the operation of the target 
computer. 

17. The system of Claim 16, wherem the host computer further comprises 
a communication device that transmits the contents of the \ideo memory and the 
keyboard and mouse buffers to a remotely located computer and receives keyboard 
and mouse data signals from the remotely located computer for storage in the set of 
keyboard and mouse buffers so that the target computer can be controlled from the 
remotely located computer. 
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